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The construction of non-computable functions used in this paper is based 
on the principle that a finite, non-empty set of non-negative integers has a 
largest element. Also, this principle is used only for sets which are excep- 
tionally ivell-defined by current standards. No enumeration of computable 
functions is used, and in this sense the diagonal process is not employed. 
Thus, it appears that an apparently self-evident principle, of constant use 
in every area of mathematics, yields non-constructive entities. 

I. INTRODUCTION 

The purpose of this note is to present some very simple instances of 
non-computable functions. Beyond their simplicity, these examples 
throw light upon the following basic point. If a function f(x) is to serve 
as an example of a non-computable function, then f(x) must be well- 
defined in some generally accepted sense; hence the efforts to construct 
examples of non-computable functions reveal the general conviction 
that over and beyond the class of computable (general recursive) func- 
tions there is a much wider class, the class of well-defined functions. The 
scope of this latter class is vague; in some quarters, there exists a belief 
that this class will be defined some day in precise terms acceptable to 
all. The examples of non-computable functions to be discussed below 
will be well defined in an extremely primitive sense; we shall use only 
the principle that a non-empty finite set of non-negative integers has a 
largest element. Furthermore, we shall use this principle only for excep- 
tionally well-defined sets; and thus our construction will rest upon con- 
siderations which occur constantly in every area of mathematics. It may 
be of interest to note that we shall not use an enumeration of computable 
functions to show that our examples are non-computable functions. 
Thus, in this sense, we do not use the diagonal process. 

II. TERMINOLOGY 

We shall use binary Turing machines (that is, Turing machines with 
the binary alphabet 0, 1), in the sense of the excellent presentation of 
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Kleene's Metamathematics (see Ref.), with the following exceptions. 
First, we do not permit a center shift; thus the machine must shift after 
the execution of an "overprint" instruction (the purpose is to simplify 
the following presentation). Second, we shall use the term "card" instead 
of "state." The reason is that the examples below were obtained as by- 
products of a logical game (the Busy Beaver game described below) 
which the writer made up to familiarize beginners with the idea of a 
Turing machine; and it appeared that terms such as state, internal con- 
figuration, and the like had a mysterious connotation for beginners. 
To illustrate some notational conventions to be used, let us consider 
the following example of a binary, 3-card Turing machine. 



Ci 




c 2 
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1 113 


111 

1 102 


112 

1 100 



Mere d , C 2 , C ;! stand for Card 1, Card 2, and Card 3. On each card, 
the left-most column contains the alphabet 0, 1 . The next column is the 
"overprint by" column; the next one is the "shift" column (where is 
the code for a left shift and 1 is the code for a right shift). The last col- 
umn is the "call card" column; it contains the index of the next card 
to be used, or (zero), where is the code for "Stop." This notation was 
found very convenient in situations where one wanted to enumerate 
(serialize) Turing machines with a given number of cards. 

The reader is assumed to be familiar with the meaning (in the sense 
of Kleene; see Ref.) of the statement that a binary Turing machine 
"computes" a function /(.r). It is understood that we consider only func- 
tions of non-negative integers with values which are again non-negative 
integers. 



1 1 r . THE BUSY BEAVER GAME 

Consider a potentially both-ways infinite tape (see Ref.), where each 
square contains a (all-zero tape). Start the 3-card machine described 
in Section II (with its Card 1) under any square. The reader will find 
that the machine stops after a few shifts, and when it stops, there are 
six ones on the tape. Actually, this particular machine is one of the four 
highest scorers (as of today) in the international BB-3 game (the 3-card 
deck classification of the Busy Beaver game). The rules in this game are 
as follows. 
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i. The contestant selects a positive integer n; and then makes up his 
own /(-card, binary, Turing machine (using the notational conventions 
explained in Section II). 

ii. He starts his machine (with its Card 1) on an all-zero tape, and 
satisfies himself that his machine stops after a certain number s of shifts. 

Hi. He then submits his entry, as well as the shift-number .s, to any 
member (in good standing) of the International Busy Beaver Club. 

iv. The umpire first verifies that the entry actually stops exactly 
after s shifts. Note that this is a decidable issue; the umpire merely 
operates the entry, persisting through not more than the specified num- 
ber 8 of shifts. If the entry fails to stop after s shifts, it is rejected; if 
it stops after fewer than s shifts, it is returned to the contestant for 
correction. After the entry has been verified, its score is the number 
of ones on the tape when it stops. 

Naturally, the BB-/» champion is the contestant who achieved the 
highest score (so far) in the BB-// classification. For example, in the 
BB-3 classification, the score of () was first achieved by R. Ilegelman 
(U.S. Naval Weapons Laboratory, Dahlgren, Virginia). This score has 
been reached since by several others; but nobody knows as yet whether 
(> is the highest possible score in the BB-3 classification. The reader who 
tries to settle this question will soon realize the difficulties involved in 
this sort of problem. Beyond the enormous number of cases to survey, 
he will find that it is very hard to see whether certain entries do stop 
at all. This is the reason for the requirement that each contestant must 
submit the shift number s with his entry. 

IV. HIGHEST SCORE 

There arises now the problem of determining the highest possible 
score in the BB-/< classification. In line with the point of view explained 
in the introduction, we formulate this problem with due care and cau- 
tion. 

Returning to rule iv. of the game, we see that a valid entry in the 
BB-/I classification is a pair (M,s), such that the following holds. 

(a) -1/ is an //-card binary Turing machine. 

(b) s is a positive integer. 

(c) .1/ stops after exactly s shifts if started (with its Card Ci) on an 
all-zero tape. 

In discussing rule iv. above, we noted that we can actually decide 
whether or not an entry (M,s) is valid. Also, if (M u si), (M->,s->) are 
valid entries such that Mi = M> , then evidently s, = s-> ; hence the 
number of valid BB-/J entries cannot exceed the number N(n) of all 
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possible n-eard, binary Turing machines. It is easy to see that 

N(n) = [4(»+ l)] 2 " (1) 

Also, there exist valid BB-n entries; for example, on choosing the 0-linc 
of Card 1 as 110, one obtains an entry which stops after one shift. 

Accordingly, if we denote by E n the set of all valid BB-n entries (M ,«), 
we obtain a non-empty, finite set E„ which has the following features. 

(a) We actually exhibit elements of E n ; so E n is non-empty as a 
matter of concrete observation. 

(b) We not only know that E H is finite, but for the number N e (n) 
of elements of this set of valid entries we have [see (1)] the in- 
equalities. 

1 < N„(n) < N(n) = [4(» + 1)]"" (2) 

(c) For every pair (M,s) we can actually decide whether or not 
(M,s) e E n . 

Evidently, E n is (by current standards) an exceptionally well-defined 
non-empty, finite set. Yet, we shall show below that N e (n), the number 
of elements of E n , is not a computable function of n. Next, each valid 
entry (M,s) e E„ has a definite score a(M,s) assigned to it (see Section 
III). Thus, for the same reasons, the set of these scores is an exceptionally 
well-defined non-empty finite set of non-negative integers. We denote 
by S(n) the largest element of this set. 
Thus 

2(ra) = max [a(M,s)} for (M,s) v. E n . (3) 

We shall see presently that 2(n) is not a computable function of n. 
Let us note, however, that it is entirely possible that 2(n) can be effec- 
tively determined for particular values of n. For example, evidently 
2(1) = 1. Also, it has been proved that 2(2) = 4. We noted above 
that we know several BB-3 entries with a score of 6; hence 2(3) ^ 6, 
and it seems plausible that 2(3) = 6. Now while for low values of n 
it is quite hard to achieve a respectable score, Dr. C. Y. Lee observed 
(in a letter to the writer) that for higher values of n one can achieve 
very large scores. The following proof for the non-computability of 2(n) 
was obtained by developing this comment of Dr. Lee. 

V. THE GROWTH OF 2(n) 

Let/(.r), g(x) be two functions (as specified in Section II). We shall 
write 

f{x) > - g(x) 
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to state that f(x) > g(x) for x greater than a certain Xq . Using this 
notation, we shall now prove the following theorem. 

Theorem. 2(w) > — f(n) for every computable (that is, general re- 
cursive) function /(w) . Hence 2(n) is not computable. 

Proof. Assign a computable function f(x). Introduce the auxiliary 
function 



F(x) = Z W) + fl- 



(4) 



Then (see Ref.) F(.v) is also computable. Evidently 

F(x) ^ f(x). 
Fix) £ .r. 
F(.r + 1) > F(.r). 



(5) 
(0) 

(7) 



Now since F(.v) is computable, we have a binary Turing machine M? , 
with a certain number C of cards (states) which computes F(x) (in 
the sense described in Kleene; see Ref.). Now assign any integer x ^ 0. 
We have then a binary Turing machine M x , with x + 1 cards (states) 
which prints on an all-zero tape x + 1 consecutive ones and stops under 
the righl-mosl one of these ones. For x = 2, for example, M {2) has the 
3 cards: 



c, 




c. 




c 3 


112 

1 110 


113 

1 --- 


101 

1 --- 



Now consider the binary Turing machine M F U) given by the symbolic 
diagram: 

If the cards of M F U) are written out with consecutive indices, then it is 
seen to have 1 + x + 2C cards. If started on an all-zero tape, M ? u will 
first print (going to the right ) a string of x + 1 consecutive ones; then, 
beyond a to the right, it will print a string of F(x) + 1 consecutive 
ones; finally, beyond a to the right, it will print a string of F[F(x)] + I 
consecutive ones, and then will stop (under the right-most 1 it printed). 
Thus evidently N P W is a valid entry in the BB-(1 + x + 20) classifi- 
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cation with a score equal to 

3 + x + F(x) + F[F(x)). 

Hence, the maximum score 2(1 + x + 2C) in this classification satisfies 
the inequality 

S( 1+ x + 2C) ^ 3 + x + F(.v) + F[F(x)]. (8) 

Now since evidently / >- (1 + x + 2C) and F(a) ^ .r 2 [see ((>)], 
it follows thai 

F(x) >- (1 + x 4- 2C). (9) 

Also, F(.r) is monotone increasing by (7); hence (9) yields 

F[F(x)] >-F(l + x + 2C). (10) 

From (8) and (10) we see that 

2(1 + x + -2C) > - F( I + x + 2C) ; 

hence (since F(.r) ^ /(«)) 

2(] + .f + 2C) >-/(l + * + 2C). 

On setting /i = 1 + x + 26', we obtain finally 

2(n) >-/(n) 

and the theorem is proved. 

The rate at which 2(.r) grows is illustrated by the following intuitive 
observation. A Turing machine M H for computing II(.v) = x\ can be 
constructed with not more than 26 states. Let us consider the chain of 
Turing machines: 

M is) -» M H -> M a -» M a -> flfii . 

It follows from (8) that the number of ones which is produced by this 
chain is more than ( ((.r!) !) !)!. Using the construction of the machine 
M H mentioned above, we may show that by combining these machines 
properly, the number of states required for this chain of machines for 
.i- = 7, for instance, is not more than 100. Therefore, 2(100) is at least 
(((7!)!)!)!. Since 2(100) is probably far bigger than this lower bound, 
it would be interesting to know how large a lower bound one can get 
for 2(100). 

VI. THE FUNCTION S(n) 

It is evident from our definitions that the set E n of valid BB-n entries 
coincides with the set of the w-card stoppers, where by a stopper we 
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mean a (binary) Turing machine which, if started on an all-zero tape 
with its card d , will stop after a while. Now the second coordinates ,s 
of the valid BB-n entries (.l/,.s) constitute a finite, non-empty set of 
positive integers; we denote by S(n) the largest element of this set. 
Thus »S{ // ) is i he maximum of the shift -numbers of the //-card stoppers. 
Clearly 

S(n) ^ S(n). (11) 

Indeed, since we do not permit center-shifts, a BB-n entry must shift 
after it prints a 1 ; thus (11) is obvious. From the theorem in Section V 
and from (II) we see that 

S(n) >-f(n) (12) 

for every computable function /(n). Thus S(n) is non-computable (the 
reader will readily see that this result is equivalent to the undecidability 
of the so-called halting problem). 

VII. THE FUXOTIOX N ,,(tl) 

This function, defined above as the number of elements of the set E„ 
(that is, (he number of re-card stoppers) does not grow unreasonably 
fast [see (2)]. However, we can discuss it as follows. Let us denote by 
N{s,n) the number of those BB-/i entries which stop after exactly s 
shifts. Evidently, the computation of N(s,n) can be readily programmed; 
informally, one finds the value of N(s,n) by running each one of the 
re-card binary Turing machines [whose number is given by (1)], per- 
sisting through not more than the given number s of shifts, and noting 
the number of those that stop after exactly s shifts. Let us put 

G(s,n) = £.N(i,n), (13) 

*(s,re) = N r (n) - G(s,n). (14) 

Clearly, G(s,n) is the number of those BB-re entries that stop after not 
more than s shifts; thus G(s,n) ^ NA.n), and hence <*>(s,/i) ^ 0. Since 
evidently G(s,n ) = N e ( n ) for s = S( n ) , we see that S(n) is the smallest 
value of s for which <p(,s,» ) = 0; in symbols: 

S(n) = (iis)[<&(s,n) = 0], (15) 

where (/x.s) means ''the smallest -s such that." From (13)— (15) it follows 
(see Kef.) that if N r (n) were computable then S(n) would be comput- 
able too; since we know that »S'(/() is not computable, it follows that 
N,(n) is non-computable. 



884 THE BELL SYSTEM TECHNICAL JOURNAL, MAY 1902 

7.1 Remark 

Suppose that, for a certain integer n , we somehow succeeded in 
determining the exact value of N,(n ). From (13)-(15) it follows that 
we can then determine S(n ) also, and hence finally 2(n ). Various 
other comments will readily occur to the reader. For example, the easily 
proved inequality 

S(n) ^ (n + 1) Z(5/i) 2 S(5 " ) 

gives rise to some curious observations. 

VIII. SUMMARY 

Inspection of the preceding presentation shows that we used in our 
constructions only the following "principle of the largest element": 
If E is a non-empty, finite set of non-negative integers, then E has a 
largest element. This principle is used constantly, as a matter of course, 
in every field of mathematics. Our examples above show that this prin- 
ciple, even if applied only to exceptionally well-defined sets E, may take 
us beyond the realm of constructive mathematics. Of course, common 
everyday experiences may be used to illustrate this sort of phenomenon. 
For example, when the writer wanted to find a certain highway on an 
automobile trip, he received the following directions from the foreman 
of a construction crew: "Drive straight ahead on this road; you will 
cross some steel bridges; and after you cross the last steel bridge, make 
a left turn at the next intersection." Luckily, the unsolvable problem 
implied by this advice was resolved by a member of the construction 
crew who volunteered the information that "after you cross the last 
steel bridge, there isn't another steel bridge until you reach Richmond, 
130 miles away." The reader may find it amusing to verify, by detailed 
study of the excellent book of Kleene (Ref.), that this little story illus- 
trates, in a concrete manner, some truly basic points in the theory of 
computable functions. 
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